Papers by Richard Jean So
KRISTEVA: Close Reading as a Novel Task for Benchmarking Interpretive Reasoning (2025.acl-long)
Copied to clipboard
Peiqi Sui, Juan Diego Rodriguez, Philippe Laban, J. Dean Murphy, Joseph P. Dexter, Richard Jean So, Samuel Baker, Pramit Chaudhuri
| Challenge: | a study of close reading skills in large language models (LLMs) shows that LLMs still lag behind human evaluators on 10 of 11 tasks. |
| Approach: | They propose a benchmark to evaluate close reading skills in large language models . they propose three tasks to approximate different elements of the close reading process . |
| Outcome: | The proposed benchmarks show that state-of-the-art LLMs possess some college-level close reading competency, but performance still trails human evaluators on 10 out of 11 tasks. |
Narrative Theory for Computational Narrative Understanding (2021.emnlp-main)
Copied to clipboard
| Challenge: | a growing body of theoretical work on narrative has been focused on the field of natural language processing . this position paper aims to provide a unifying framework for the computational study of narrative . |
| Approach: | They propose to introduce dominant theoretical frameworks to the NLP community and situate current research within distinct narratological traditions. |
| Outcome: | The proposed framework would allow for new empirical questions and applications in the field of natural language processing. |